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Abstract 

Data centers have emerged as promising resources for demand response, particularly for emergency demand response (EDR), 
which saves the power grid from incurring blackouts during emergency situations. However, currently, data centers typically 
participate in EDR by turning on backup (diesel) generators, which is both expensive and environmentally unfriendly. In this 
paper, we focus on “greening” demand response in multi-tenant data centers, i.e., colocation data centers, by designing a pricing 
mechanism through which the data center operator can efficiently extract load reductions from tenants during emergency periods 
to fulfill energy reduction requirement for EDR. In particular, we propose a pricing mechanism for both mandatory and voluntary 
EDR programs, ColoEDR, that is based on parameterized supply function bidding and provides provably near-optimal efficiency 
guarantees, both when tenants are price-taking and when they are price-anticipating. In addition to analytic results, we extend the 
literature on supply function mechanism design, and evaluate ColoEDR using trace-based simulation studies. These validate the 
efficiency analysis and conclude that the pricing mechanism is both beneficial to the environment and to the data center operator 
(by decreasing the need for backup diesel generation), while also aiding tenants (by providing payments for load reductions). 

I. Introduction 

Data centers have emerged as a promising demand response opportunity. However, data center demand response today is not 
environmentally friendly since data centers typically participate by turning on backup (diesel) generators. In this paper, we focus 
on designing a pricing mechanism for a crucial class of data centers for demand response - multi-tenant colocation data centers 
- that allows the data center operator to encourage load shedding among tenants in response to demand response signals; thus 
greening data center demand response by reducing the need for use of backup (diesel) generation. 

Data center demand response. Power-hungry data centers have been quickly expanding in both number and scale to support 
the exploding IT demand, consuming 91 billion kilowatt-hour (kWh) electricity in 2013 in the U.S. alone 1291 . While traditionally 
viewed purely as a negative, the massive energy usage of data centers has recently begun to be recognized as an opportunity. In 
particular, because the energy usage of data centers tends to be flexible, they are promising candidates for demand response, which 
is a crucial tool for improving grid reliability and incorporating renewable energy into the power grid. Erom the grid operator’s 
perspective, a data center’s flexible power demand serves as a valuable energy buffer, helping balance grid power’s supply and 
demand at runtime 1431 . 

To this point, data center is a promising, but still largely under-utilized opportunity for demand response. However, this is 
quickly changing as data centers play an increasing role in emergency demand response (EDR) programs. EDR is the most 
widely-adopted demand response program in the U.S., representing 87% of demand reduction capabilities across all reliability 
regions 1251 . Specifically, during emergency events (e.g., extreme weather or natural disasters), EDR coordinates many large 
energy consumers, including data centers, to shed their power loads, serving as the last protection against cascading blackouts that 
could potentially result in economic losses of billions of dollars 1271 . dD. The U.S. ERA has identified data centers as critical 
resources for EDR mi, which was attested to by the following example; on July 22, 2011, hundreds of data centers participated 
in EDR by cutting their electricity usage before a large-scale blackout would have occurred im. 
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While data centers are increasingly contributing to EDR, they typically participate by turning on their on-site backup diesel 
generators, which is neither cost effective nor environmentally friendly. For example, in California (a major data center market), 
a standby diesel generator often produces 50-60 times more nitrogen oxides (a smog-forming pollutant) compared to a typical 
power plant for each kWh of electricity, and diesel particulate represents the state’s most significant toxic air pollution problem 

OH- 

In addition, relying on diesel generation for EDR presents emerging challenges which, if left unaddressed, may forfeit data 
center’s EDR capability. First, as EDR is becoming more frequent, the current financial compensation offered by power grid to data 
centers (for committed energy reduction during EDR) may not be enough to cover the growing cost of diesel generation. Second, 
data center operators are aggressively cutting the huge capital investment in their power infrastructure (e.g., 10-15$/watt m, (22l), 
by down-sizing the capacity of diesel generator and uninterrupted power supply (UPS) system 1391 . Such under-provisioning of 
diesel generator may compromise data center’s EDR capability. Therefore, to retain and encourage data center’s participation in 
EDR without contaminating the environment, it is critical and urgent that data centers seek alternative ways to shed load. 

Consequently, modulating server energy for green EDR (as well as other demand response programs such as regulation service 
1201 ) has received an increasing amount of attention in recent years, e.g., ID, El, Q, 113, Eol . (23, im, 113 • These studies 
leverage various widely-available IT computing knobs (e.g., server turning on/off and workload migration) in data centers and 
provide algorithms to optimize them for participation in demand response markets. Importantly, these are not simply theoretical 
studies. For example, a field study by Lawrence Berkeley National Laboratory (LNBL) has illustrated that data centers can reduce 
energy consumption by 10-25% in response to demand response signals, without noticeably impacting data center’s normal 
operation m. 

Demand response in collocation data centers. While existing studies on data center demand response show promising 
progress, they are primarily focused on owner-operated data centers (e.g., Google) whose operators have full control over both 
servers and facilities. Unfortunately, such companies may actually be the least likely to participate in demand response programs, 
because many of their workloads are extremely delay sensitive and their data centers have been optimized for delay. 

In this paper, we focus on another type of data centers — multi-tenant colocation data centers (e.g., Equinix). These have 
been investigated much less frequently, but are actually better targets for demand response then owner-operated data centers. In a 
colocation data center (simply called “colocation” or “colo”), multiple tenants deploy and keep full control of their own physical 
servers in a shared space, while the colo operator only provides facility support (e.g., high-availability power and cooling). Colos 
are less studied than owner-operated data centers, but they are actually more common in practice. Colos offer data center solutions 
to many industry sectors, and serve as physical home to many private clouds, medium-scale public clouds (e.g., VMware) (^, 
and content delivery providers (e.g., Akamai). Further, a recent study shows that colos consume nearly 40% data center energy in 
the U.S., while Google-type data centers collectively account for less than 8%, with the remaining going to enterprise in-house 
data centers 1291 . 

In addition to consuming a significant amount of energy (more than Google-type data centers), colos are often located in 
places more useful for demand response. While many mega-scale owner-operated data centers are built in rural areas, colos are 
mostly located in metropolitan areas (e.g., Los Angeles, New York) m, which are the very places where EDR is most needed. 
Further, workloads in colos are highly heterogenous, and many tenants run non-mission-critical workloads (e.g., lab computing 
1371 ) that have very high scheduling flexibilities, different delay sensitivities, peak load periods, etc., which is ideal for demand 
response participation. 

For all these reasons, colos are key participants in EDR programs. Compared to owner-operated data centers that can leverage 
various computing knobs, however, greening colos’ participation in EDR by reducing reliance on diesel generator is significantly 
more challenging, because of colo operators’ lack of control over their tenants’ servers. On the other hand, many tenants in colos 
run servers hosting highly-flexible and non-critical workloads with a great potential for shedding loads when called upon 03. 


Thus, tenants’ load shedding potentials, if appropriately exploited, can altogether form a green alternative to diesel generation 
for colo EDR. Nonetheless, tenants manage their own servers independently and may not have incentive to cooperate with the 
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operator for EDR, thus raising the research question: how can a colo operator efficiently incentivize its tenants’ load shedding for 
EDR'l] 

Contributions of this paper. In this paper, we focus on “greening” colocation demand response by extracting load reduction 
from tenants instead of relying on backup diesel generation. We study both mandatory EDR, a type of EDR program in which 
participants sign contracts and are obliged to reduce loads when requested (SD, and voluntary EDR, where participants voluntarily 
reduce loads for financial compensation upon grid request. In both cases, we propose a new pricing mechanism with which colo 
operators can extract load shedding from tenants. In particular, our proposed approach, called ColoEDR, can effectively provide 
incentives for tenants to reduce energy consumption during EDR events, complementing (and even substituting for) the high-cost 
and environmentally-unfriendly diesel generation. 

ColoEDR works as follows. After an EDR signal arrives at the colo operator, tenants bid using a parameterized supply 
function, and then the colo operator announces a market clearing price which, when plugged into the bids, specifies how much 
energy tenants will reduce and how much they will be paid. Participation by the tenants is straightforward, since they are required 
to bid only one parameter, which can be viewed as a proxy of how much flexibility in energy usage they have at that moment. 

This participation can be automated and so can be easily incorporated into current practice, and mimics the way generation 
resources participate in electricity markets more broadly. For example, colo operators at Verizon Terremark already communicate 
with tenants in preparation for an EDR event. 

The main technical contribution of the paper is the analysis of the efficiency of the supply function mechanism proposed in 
ColoEDR. In particular, while there is a large literature studying supply function bidding (5), 1101 . 1161 - 1181 . our setting here 
is novel and different because the colo operator can either satisfy the EDR request using flexibility from the tenants (as in prior 
supply funding literature) or through its backup diesel generator. Thus, the diesel generator is an outside option that allows for 
elasticity in the amount of response extracted from the tenants. Further, the colo operator can combine and balance between its 
two options (i.e., tenant load shedding and backup generator) in order to minimize costs. This creates a multi-stage game and 
adds a considerable complexity as compared to the standard setting without an outside option, e.g., dl. 

Despite the added complexity, our analysis precisely characterizes the equilibrium outcome, both when tenants are price¬ 
taking and when they are price-anticipating. In both cases, our results highlight that ColoEDR suffers little performance loss 
compared to the socially optimal outcome, both from the operator’s and the tenants’ perspectives. However, our analysis does 
highlight one possible drawback of ColoEDR. In the worst case, it is possible that ColoEDR may result in using significantly 
more on-site diesel generation than would the socially optimal. However, this bad event occurs only in cases where one tenant 
has an overwhelmingly dominant amount of servers and has a unit cost (for energy reduction) just below that of on-site diesel 
generation. Such an exploitation of market power is unlikely to be possible in practical multi-tenant colocation data centers. 

In addition to our theoretical analysis, we investigate a case study of colocation demand response in evil using trace-based 
experiments. The results further validate the design of ColoEDR, and show that it achieves the mandatory energy reduction for 
EDR while benefiting tenants through financial incentives and decreasing the operator’s cost. Moreover, our simulation study 
shows that the efficiency loss in practical settings is even lower than what is suggested by the analytic bounds. This is especially 
true for the amount of on-site generation, which the analytic results suggest can (in the worst-case) be significantly larger than 
socially optimal but in realistic settings is very close to the social optimal. 

'Tenants receive UPS-protected power from colo operator and share cooling systems. In other words, tenants’ total energy consumption is not directly 
provided by grid and includes non-separable cooling energy, which makes tenants ineligible for direct participation in EDR El]. 
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II. Problem Formulation 

Our focus is to design a mechanism for a colo operator to extract tenant load reductions in response to to an EDR signal. 
Thus, we need to begin by describing a model for a colo operator. 

Recall that the colo operator is responsible for non-IT facility support (e.g., high-availability power, cooling). We capture 
the non-IT energy consumption using Power Usage Effectiveness (PUE) 7 , which is the ratio of the total colocation energy 
consumption to the IT energy consumption. Typically, 7 ranges from 1.1 to 2.0, depending on factors such as outside temperature. 

When the operator receives an EDR signal from the LSE, it has two options for satisfying the load reduction. Eirst, without 
involving the tenants, the colo operator can use its on-site backup diesel generator]^ We denote the amount of energy reduction 
by diesel generation by y and the cost per kWh of diesel generation (e.g., for fuels) by a. 

Alternatively, the colo operator could try to extract IT load reductions from the tenants. We consider a setting where there 
are N tenants, i £ N = {1, 2, • • • , N}. When shedding energy consumption, a tenant i will incur some costs and we denote 
the cost from shedding Si by a function Ci{si). These costs could be due to wear-and-tear, performance degradation, workload 
shifting, etc. For the purposes of our model, we do not specify which technique reduces the IT load, only its cost. For details on 
how one might model such costs, see El, Gil, (30l, ED- A standard, natural assumption on the costs is the following. 
Assumption 1. For each n, the cost function Cn(s„) is continuous, with Cn(sn) = 0 if Sn if 0- Over the domain Sn > 0, the 
cost function Cn is convex and strictly increasing. 

Intuitively, convexity follows from the conventional assumption that the unit cost increases as tenants reduce more energy 
(e.g., utilization becomes higher when servers are off, leading to a faster increase in response time of tenants’ workloads). 

III. Pricing Tenant Load Shedding in Mandatory EDR 

EDR is the last line of protection against cascading power failures, and represents 87% of demand reduction capabilities 
across all the U.S. reliability regions 1251 . In general, there are two types of EDR programs: mandatory and voluntary (also called 
economic) (m. We focus on mandatory EDR first, and return to voluntary EDR in Section lYl 

For mandatory EDR, participants typically sign contracts with a load serving entity (LSE) in advance (e.g., 3 years ahead 
in PJM 1311 ) and receive financial rebates for their committed energy reduction even if no EDR signals are triggered during the 
participation year, whereas non-compliance (i.e., failure to cut load as required during EDR) incurs heavy penalty (H). If an LSE 
anticipates that an emergency will occur, participants are notified, usually at least 10 minutes in advance, and obliged to fulfill 
their contracted amounts of energy reduction for the length of the event, which may span a few minutes to a few hours. 

In mandatory EDR, the colo operator has two options for obtaining load reductions in response to an EDR signal that specifies 
the reduction amount - tenants or on-site generation. Thus, it must balance between paying tenants for reduction and using on-site 
generation in order to minimize cost. Note that tenants’ load reduction can also reduce the usage of diesel generator, mitigating 
environmental impacts. Nonetheless, the challenge is that the operator does not know the tenant cost functions, and so cannot 
determine the cost-minimizing price. 

Consequently, the operator has two options: (i) predict the tenant supply function and compute prices based on the predictions, 
or (ii) allow tenants to supply some information about their cost functions through bids. Clearly, there is a tradeoff here between 
the accuracy of predictions and the manipulation possible in the bids. Both of these approaches have been looked at in the literature 
d, Cni, d, (24l, 1281 . though not in the context of colo demand response. In general, the broad conclusion is that approach 
(i) is appropriate when predictions are accurate and one bidder has market power (e.g., is significantly larger than other bidders). 
While market power is a considerable issue for the participation of owner-operated data centers in demand response programs due 

^Other alternatives, e.g., battery [U. usually only last for < 5 minutes. So, diesel generation is the typical method El 
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to their large size compared to other participants, it is not an issue within a specific colo that houses multiple tenants (typically 
of comparable sizes), and so we adopt approach (ii) in this paper. 

Specifically, we design a mechanism, named ColoEDR, where tenants bid using parameterized supply functions and then, 
given the bids, the operator decides how much load to shed via tenants and how much to shed via on-site generation. In the 
following, we describe the mechanism and then contrast our approach with other potential alternatives. 

Note that, throughout this paper, we focus on one EDR event, and thus we omit the time index. In the case of multiple 
consecutive EDR events, ColoEDR will be executed once at the beginning of each event, as is standard in the literature dn, 

(m. 

A. An overview of ColoDR 

The operation of ColoEDR is summarized below, and then discussed in detail in the text that follows. 

1) The colo operator receives an EDR reduction target 5 and broadcasts the supply function S{bn,p) to tenants according to ([Til; 

2) Participating tenants respond by placing their bids bn', 

3) The colo operator decides the amount of on-site generation y and market clearing price p to minimize its cost, using equations 
(|2} and (|^; 

4) EDR is exercised. Vn G N, tenant n sheds S{bn,p), and receives pS{bn,p) reward. 

Given the overview above, we now discuss each step in more detail. 

Step 1. Upon receiving an EDR notification of an energy reduction target <5, the colo operator broadcasts a parameterized 
supply function S{b,p) to tenants (by, e.g., signalling to the tenants’ server control interfaces, which are widely existing today). 

The form of S{b,p) is the following parameterized famil}!^: 

S{bn,p)=5-^. ( 1 ) 

P 

where p is offered reward for each kWh of energy reduction and bn is the bidding values that can be chosen by tenant n. This 
form is inspired by (H, where it is shown that by restricting the supply function to this parameterized family, the mechanism 
can guide the firms in the market reach to an equilibrium with desirable properties^ Note that, to be consistent with the supply 
function literature, we exchangeably use “price” and “reward rate” wherever applicable. 

Step 2. Next, according to the supply function, each participating tenant submits its bid bn to the colo operator. This bid 
specifies that, at each price p, it is willing to reduce S{bn,p) unit of energy. The bid is chosen by tenants individually to maximize 
their own utility and can be interpreted as the amount of IT service revenue that tenant n is willing to forgo. Note that bn can be 
chosen to ensure that tenant n will not be required to reduce more energy than its capacity. To see this, note that since the operator 
is cost-minimizing, p(b, y) < a always holds, i.e., the market clearing price is lower than the unit cost of diesel generation. 
Hence, if Kn is the capacity of reduction for tenant n, as long as bn > a{5 — Kn), then 

Sibn,p)=S-—<S-—<Kn. 
p a 

An important note about the tenant bids is that the supply function is likely of a different form than the true cost function Cn, 
and so it is unlikely for the tenants to reveal their cost functions truthfully. This is necessary in order to provide a simple form 
for tenant bids. Bidding their true cost functions is too complex and intrusive. However, a consequence of this is that one must 

^The .supply function allows tenants to have negative supply, i.e., tenants consume more energy intentionally, which is neither profit maximizing nor practical. 
We show in illVI that energy reduction of each tenant is always nonnegative in both equilibrium and social optimal outcomes. 

^ [U studies the case where firms bid to supply an inelastic demand, which is equivalent to fixing the diesel generation y = 0 in our case. Allowing the 
operator to choose y in a cost-minimizing manner leads to significantly different results, as will be shown in ^IV-AI and ^IV-BI 
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carefully analyze the emergent equilibrium to understand the efficiency of the pricing mechanism. We study both the cases of 
price-taking and price-anticipating equilibrium in 3IVI 

Step 3. After tenants have submitted their bids, the colo operator decides the amount of energy y to produce via on-site 
generation and the clearing price p. Given y, the market clearing price has to satisfy E„5'(p(b), 6„) + y = S, thus 

To determine the amount of local generation y, the operator minimizes the cost of the two load-reduction options, i.e., 

y = a.rgmm{5 - y) ■ p{h,y) + ay. (3) 

0<y<5 

Step 4. Finally, EDR is exercised and tenants receive financial compensation from the colo operator via the realized price in 
13, shed load S{p,b„), and on-site generation produces 13- 

B. Discussion 

To the best of our knowledge, this paper represents the first attempt to design a supply function bidding mechanism for 
colocation demand response. Although alternative mechanisms may be applicable, there are compelling advantages to the supply 
function approach. First, bidding for the tenants is simple - they only need to communicate one number, and it is already common 
practice for operators to communicate with tenants before EDR events, so the overhead is small. Second, the colo operator collects 
just enough information (i.e., how much energy reduction each tenant will contribute to EDR), while tenants’ private information 
(i.e., how much performance penalty/cost each for energy reduction) is masked by the form of the supply function and hence not 
solicited. Third, ColoEDR guarantees that the colo operator will not incur a higher cost than the case where only diesel generator 
is used. Further, ColoEDR pays a uniform price to all participating tenants and hence ensures fairness. 

The most natural alternative design to supply function bidding is a VCG-based mechanism, as is suggested in 1461 . While 
VCG-based mechanisms have the benefits of incentive compatibility, however, these mechanisms violate all the four properties 
discussed above. Under such approaches, tenants must submit very complex bids describing their precise cost functions, the true 
private cost of tenants is disclosed, payment made to tenants may be unbounded, and prices to different tenants are differentiated 
and thus raises unfairness issues. 

Due to these shortcomings, VCG-based mechanisms are typically not adopted in complex resource allocation settings such 
as power markets, where supply-function based designs are common (H. In fact, nearly all generation markets use a variation 
of supply function bidding. 


IV. Efficiency Analysis of ColoEDR for Mandatory EDR 

Given the ColoEDR mechanism described above, our task now is to characterize its efficiency. There are two potential causes 
of inefficiency in the mechanism: the cost minimizing behavior of the operator and the strategic behavior (bidding) of the tenants. 
In particular, since the forms of the tenant’s cost functions are likely more complex than the supply function bids, tenants cannot 
bid their true cost function even if they wanted to. This means that evaluating the equilibrium outcome is crucial to understanding 
the efficiency of the mechanism. 

Further, the equilibrium outcome that emerges depends highly on the behavior of the tenants - whether they are price-taking, 
i.e., they passively accept the offered market price p as given when deciding their own bids; or price-anticipating, i.e., they 
anticipate how the price p will be impacted by their own bids. We investigate both models, in 3IV-AI and 3IV-BI respectively. 
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In both cases, the goal of our analysis is to assess the efficiency of ColoEDR. To this end, we adopt a notion of a (socially) 
optimal outcome, and focus on the following social cost minimization problem. 

SCM : min ay + Ci{si) 

ieAf 

s.t. y + 7 ■ ^ Si = 5 

iej\f 

Si > 0, Vi G Af, y > 0 

where Si and d are tenant i’s energy reduction and corresponding cost, respectively. 

The objective in SCM can be interpreted as the tenants’ cost plus the colo operator’s cost. Note that the internal payment 
transfer between the colo operator and tenants cancels, and does not impact the social cost. Also, note that payment from the LSE 
to the colo operator is not included in the social cost objective, since it is independent of how the operator obtains the amount of 
5 load reduction. Additionally, we do not include the option of ignoring the event and taking the penalty, since the penalties for 
lack of participation are typically extreme. Finally, the Lagrangian multiplier of ( I4bt can be interpreted as the social optimal price 
p*, i.e., given this price as reward for energy reduction, each tenant will individually reduce their energy by Sn that corresponds 
to the social cost minimization solution in ©. 

Before moving to the analysis, in order to simplify notation, we suppress the PUE 7 by, without loss of generality, setting 
7 = 1 . This is equivalent to a change of notation y' = J// 7 , 5' = 5 / 7 , and a' = 07 , i.e., translating the diesel generation, unit 
cost of diesel generation, and EDR energy reduction target into their respective equivalent amounts in terms of server energy. 

A. Price-Taking Tenants 

When tenants are price-taking, they maximize their net utility, which is the difference between the payment they receive and 
the cost of energy reduction, given the assumption that they consider their action does not impact the price. 


(4a) 

(4b) 

(4c) 


Pn{bn,p) = pS„{bn,p) - Cn{S„{bn,p)) (5a) 

= p5 - bn - Cr^ (^5 - . (5b) 

Here, the price-taking assumption implies that the variable p is considered to be as is. The market equilibrium for price-taking 
tenants is thus defined as follows. 

Definition 1. A triple {h,p,y) is a (price-taking) market equilibrium if each tenant maximizes its payoff defined in ([3, market 
is cleared by setting price p according to and the amount of on-site generation is decided by 13, i.e.. 


Pn{hn\p) > Pn{hn\p) Vbn > 0, n=l,...,N. 

_ ^ieAt 

P- (N-l)5 + y- 


(6) 

(7) 


y = arg min(5 - y) ■ p{h, y) + ay. 

0<y<5 


( 8 ) 


1) Market Equilibrium Characterization: The key to our analysis is the observation that the equilibrium can be charac¬ 
terized by an optimization problem. Once we have this optimization, we can use it to characterize the efficiency of the equilibrium 
outcome. This approach parallels that used in mi; however, the optimization obtained has a different structure due to local diesel 
generation. Additionally, though we use an optimization to characterize the equilibrium, the game is not a potential game. 

Our first result highlights that, given any choice for on-site generation, a unique market equilibrium exists for the tenants, 
and can be characterized via a simple optimization. 



Proposition 1. Under Assumption [7] when tenants are price-taking, for any on-site generation level 0 < j/ < 5, there exists 


a market equilibrium, i.e., a vector = {bi,..., b%) 

Sn = S{bn,p) is the optimal solution of the following 

> 0 and a scalar p 

> 0 that satisfies ©, and the resulting allocation 

min 

Ci(Si) 

(9a) 




s.t. 

Si = (5 - y), 

(9b) 


ieM 



Si >0, Vi G Af. 

(9c) 


This result is a key tool for understanding the overall market outcome. Intuitively, the operator running ColoEDR is more 
likely (than the social optimal) to use on-site generation, since this reduces the price paid to tenants. The following proposition 
quantifies this statement. 

Proposition 2. Under Assumption [7] it is optimal for price-taking tenants to use on-site generation if and only if 

_ ^ (^nbn) Isl 

(10) 

However, when the operator is profit maximizing, it will turn on on-site generation if and only if 


N 

AT - 1 (AT - 1)5’ 


( 11 ) 


This proposition is an important building block because the most interesting case to consider is when it is optimal to use 
some on-site generation and some tenant load shedding, i.e., S > y* > 0. Otherwise the EDR demand should be entirely fulfilled 
by tenants, and the analysis reduces to the case of an inelastic demand, as studied in dl. Thus, subsequently, we make the 
following assumption, which ensures that on-site generation is valuable. 

Assumption 2. The unit cost of on-site generation is cheap enough that the optimal on-site generation is non-zero, i.e., a satisfies 

Oil- 

Note that, when Assumption |2] holds, by first-order optimality condition of ([^ we have 


y = 


(T.ieMbi)N6 


{N-l)5, 


( 12 ) 


and so the market clearing price for the tenants given on-site generation is 

_ _ j {T,i^Mbi)a 

{N-l)5 + y ~ V W6 


(13) 


Using these allows us to prove a complete characterization of the market equilibrium under price-taking tenants. This theorem 
is the key to our analysis of market efficiency. 

Theorem 3. When Assumptions\I\and^hold there is a unique market equilibrium, i.e., a vector b* = (bi,... ,b% ) > 0, t/‘ > 0 
and a scalar p* > 0 that satisfies ©-(lU, and the resulting allocation (s*,y*) where Sn = S{bn,p^) is the optimal solution of 

^We adopt the convention that § = 0 and ^ = -\-oo when x > 0. Therefore, when = 1, unless the bid is 0, the condition is always satisfied. 
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the following problem 

min Y^Cr^isr.) + ^{y + {N - l)5f 

n 

s.t. Y,Sn = s - y, 

n 

Sn > 0, Vn, y > 0. 


(14a) 

(14b) 

(14c) 


2) Bounding Efficiency Loss: We now use Theorem to bound the efficiency loss due to strategic behavior in the market. 
Denote the socially optimal on-site generation by y*, the optimal price that leads to the optimal allocation Si, Vi G Af by p*, and 
let y* and be the allocation under the price-taking assumption. 

Our first result highlights that, due to the cost-minimizing behavior of the operator, the equilibrium outcome uses more on-site 
generation and pays a lower price to the tenants than the social optimal. 

Proposition 4. Suppose that Assumptions \I]atTd^ hold. When tenants are price-taking, the operator running ColoEDR uses 
more on-site generation and pays a lower price for power reduction to its tenants than the social optimal. Specifically, y* > y* 
and < P* < P* • 

Now, we move to more detailed comparisons. There are three components of market efficiency that we consider: social welfare, 
operator cost, and tenant cost. 

First, let us consider the social cost. 

Theorem 5. Suppose that Assumptions\T\and^hold. Let (s*,y‘) be the allocation when tenants are price-taking, and (s*,y*) 
be the optimal allocation. Then the welfare loss is bounded by: <^rz(Sn) + ay^ < Cn(s^) + ay* -t- aS/2N. 

Importantly, this theorem highlights that the market equilibrium is quite efficient, especially if the number of tenants is large 
(the efficiency loss decays to zero as 0{1/N)). However, the market could maintain good overall social welfare at the expense 
of either the operator or the tenants. The following results show this is not true. 

Let costo(p, y) be the operator’s cost, i.e.. 


costo(p,y) = p{5 -y) + ay. 


(15) 


Then, we have the following results. 

Theorem 6. Suppose that Assumptions\I]and^are satisfied. The cost of colo operator with price-taking tenants is smaller than 
the cost in the socially optimal case. Further, we have costo(p*,y*) — aS/N < costo(p*,y*) < costo(p*, y*). 

B. Price-Anticipating Tenants 

In contrast to the price-taking model, price-anticipating tenants realize that they can change the market price by their bids, 
i.e., that p is set according to GD, and adjust their bids accordingly. Clearly, this additional strategic behavior can lead to larger 
efficiency loss. But, in this section, we show that the extra loss is surprisingly small, especially when a large number of tenants 
participate in ColoEDR. 

Given bids from the other tenants, each price-anticipating tenant n optimizes the following cost over bidding value bn 


Qn(hn,t)_Ti) — y(b)5'n(hn,p) Cn{Sn(.bn,p')') 
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where we use b_„ to denote the vector of bids of tenants other than n; i.e., b_„ = (for,..., 6„_i, , fejv). Thus, 

substituting 0 and d, we have 


Q b_7i) 




N 


bji Cn 



(16) 


Note that the payoff function Qn is similar to the payoff function Pn in the price-taking case, except that the tenants anticipate 
that the colo operator will set the price p according to p — p(h, y) from ( I13t . 

Definition 2. A triple {h,p,y) is a (price-anticipating) market equilibrium if each tenant maximizes its payoff defined in ( I16t , 
the market is cleared by setting the price p according to 0 and the amount of on-site generation is decided by 0, i.e., 


Qnifin, byi) ^ Qn(,bn, bjj) ^ O5 1, . . . , N 

bn 


(N-l)5 + y' 


y = arg min(5 - y) ■ p(b, y) + ay. 

0<y<S 


(17) 

(18) 
(19) 


Note that our analysis in this section requires one additional technical assumption about the tenant cost functions. 
Assumption 3. The marginal cost of all the tenants at 0 is greater than i.e., ^ Vn. 

This assumption is quite mild, especially if the number of tenants N is large. Intuitively, it says that the unit cost of on-site 
generation is competitive with the cost of tenants reducing their server energy. 

]) Market Equilibrium Characterization: Our analysis of market equilibria proceeds along parallel lines to the price¬ 
taking case. We again show that there exists a unique equilibrium and, furthermore, that the tenants and operator behave in 
equilibrium as if they were solving an optimization problem of the same form as the aggregate cost minimization but with 
“modified” cost functions. 

Theorem 7. Suppose that Assumption \l\3\ are satisfied, then there exists a unique equilibrium of the game defined by 

(Qi, ..., Qn) satisfying ifTTll-d. For such an equilibrium, the vector s“ defined by s“ = S'(p(b“),6“) is the unique optimal 

solution to the following optimization: 


min '^Cn{sn) + ^^{y + (N - 1)S)^ (20a) 

n 

s.t. Sn = S — y (20b) 

n 

y > 0, s„ > 0, n = 1,..., N, (20c) 


where, for Sn > 0, 


Cn 



H" Sn 


a \ 1 r 

2 n) 2J0 


/ d+Cn{z) 
\ dz 



I r, d+Cn{z) za _ 

dz N5 


( 21 ) 


and for Sn < 0, Cn(sn) = 0. 

Although the form of Cn(sn) looks complicated, there is a simple linear approximation that gives useful intuition. 
Lemma 8. Suppose that AssumBtion \l\3\ are satisfied. For all modified cost Cn,n £ 1,... ,N, for any 0 < Sn < 5, 


Cn)Sn) ^ Cn)Sn) ^ Cn)Sn) “t” Sr, 


2N' 


Furthermore, when the left or right derivatives of £(■) is defined, it can be bounded by 

d~Cn{Sn.) ^ d~c{Sn) ^ 8^ c[Sn) ^ 8^ CnjSn) _a_ 

8Sn. ~ 8Sn. ~ 8Sn ~ 8Sn. 2N ' 
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The form of Lemma shows that the difference between the modified cost function in (ED and the true cost diminishes as N 
increases, and this is the key observation that underlies our subsequent results upper bounding the efficiency loss of ColoEDR. 

2) Bounding Efficiency Loss: We now use Theorem 0 to bound the efficiency loss due to strategic behavior. Note that, by 
comparing to both the socially optimal and the price-taking outcomes, we can understand the impact of both strategic behavior 
by the operator and the tenants. 

Our first result focuses on comparing the price-anticipating and price-taking equilibrium outcomes. It highlights that price- 
anticipating behavior leads to tenants receiving higher price while providing less load shedding. 

Theorem 9. Suppose Assumption liOl hold. Let {p*,y^) be the equilibrium price and on-site generation when tenants are price¬ 
taking, and (p“,2/“) be those when tenants are price-anticipating, then we have, y* < 3 /“ < J/*-f 5/2 and < p°' < p^ af2N. 

Next, combining Theorem and Proposition |4] yields the following comparison between the price-anticipating and socially 
optimal outcomes. 

Corollary 10. Suppose Assumption lilil hold. When tenants are price-anticipating, an operator running ColoEDR uses more 
on-site generation atid pays lower market price than in the socially optimal case, i.e., y“ > y* and P* ^ P°' < P*- 

Now, we move to more detailed comparisons. There are three components of market efficiency that we consider: social welfare, 
operator cost, and tenant cost. 

First, let us consider the social cost. 

Theorem 11. Suppose that Assumption UX^ hold. Let (s“,y“) be the allocation when tenants are price-anticipating, and (s*,y*) 
be the optimal allocation. The welfare loss is bounded by: Cnfsf) -\- ay°' < Cn(Sn) -I- ay* aS/N. 

Similarly to the price-taking case, the efficiency loss in the price-anticipating case decays to zero as 0{1/N), only with a 
larger constant. Also, as in the case of price-taking tenants, we again see that neither the tenants nor the operator suffers significant 
efficiency loss. 

Theorem 12. Suppose that Assumption n\3\ hold. The cost ofcolo operator for price-anticipating tenants is smaller than the cost 
in the socially optimal case. Further, we have 

cxS 

costo(p*,y*) - < costo(p“,y“) < costo(p*, y*), 

costo(p“,y“) - ^ < costo(p‘,y‘) < costo(p“,y“) 

Finally, let us end by considering the amount of on-site generation used in equilibrium. Here, in the worst-case, the equilibrium 
on-site generation for price-anticipating tenants can be arbitrarily worse than the socially optimal, i.e., the socially optimal can 
use no on-site generation while the equilibrium outcome uses only on-site generation. 

Theorem 13. Suppose that Assumption I7I3I hold. For any e > Q, N > 1, there exist cost functions ci,..., cjv, such that the 
on-site generation in the market equilibrium compared to the optimal is given by y°‘ — y* > S — e. 

This is a particularly disappointing result since a key goal of the mechanism is to obtain load shedding from the tenants. 
However, the proof emphasizes that this is unlikely to occur in practice. In particular, the worst-case scenario is that there exists 
a dominant (monopoly) tenant, which is unlikely in a multi-tenant colo, that has a cost function asymptotically linear with unit 
cost roughly matching the on-site generation price a. We confirm this in a case study in Section m 
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C. Discussion 

The main results for the price-taking and price-anticipating analyses are summarized in Table U Note that simplified bounds 
are presented in the table, to ease interpretation, and the interested reader should refer to the theorems in 3IV-AI and ^IV-BI for 
the tightest bounds. Also, note that the benchmark for social cost we consider is an ideal, but not achievable, mechanism. 


Tenants 

Price Ratio 

Colo Saving 

Welfare Loss 

Price-taking 

IJ 

[0, a5/N] 

[0, a5/2N\ 

Price-anticipating 

1] 

[0, aS/N] 

[0, aS/N] 


--—TABLh 1-- 

Performance guarantee of CoIoEDR compared to the social optimal allocation. 

To summarize the results in Table |I] briefly, note first that ColoEDR always benefits the operator, since the price paid to 
tenants to reduce energy is always less than the socially optimal price, and the total cost incurred by operator for energy reduction 
is also less than that of the social optimal. Secondly, ColoEDR also gives the tenants approximately the social optimal payment, 
since the operator’s additional benefit is bounded above by aS/N. This naturally means that the loss in payment for tenants 
compared to the social optimal is also aS/N, which approaches 0 as grows. Third, regardless of tenants being price-taking or 
price-anticipating, ColoEDR is approximately socially cost-minimizing as the number of tenants grows. 

However, while ColoEDR is good in terms of operator, tenant, and social cost, it may not use the most environmentally 
friendly form of load reduction; in the worst case, the upper bound on the extra on-site generation that ColoEDR uses is not 
decreasing with N. However, the analysis highlights that this worst-case occurs when there exists a dominant tenant with unit 
cost of energy reduction that is consistently just below the cost of diesel over a large range of energy reduction. As our case 
study in ^VII shows, this is unlikely to occur in practice. So, ColoEDR can be expected to use an environmentally friendly mix 
in most realistic situations. 


V. Pricing Tenant Load Shedding in Voluntary EDR 

We now turn from mandatory EDR to voluntary EDR and show how the analysis and design of ColoEDR can be extended. 
Under voluntary EDR, a colo operator is offered a certain compensation rate for load reduction and can cut any amounts of energy 
at will without any obligation. Voluntary EDR often supplements mandatory EDR, and both are widely adopted in practice 1251 . 

Since the colo operator can freely decide on the amount of energy to cut based on the compensation rate the amount of 
energy reduction responses from tenants is fully elastic, differing from mandatory EDR where the total energy reduction (including 
diesel generation if necessary) needs to satisfy a constraint S. 

In the following, we formulate the problem and generalize ColoEDR for the voluntary EDR setting. Furthermore, we illustrate 
that the efficiency analysis, though more complicated, parallels that of mandatory EDR. 

A. Problem Formulation 

During a voluntary EDR event, the LSE offers a reward of u for each unit of energy reduction (or diesel generation if 
applicable). In our setting, the colo operator aims at maximizing its profit through extracting loads from tenants using parameterized 
supply function bidding, as considered for mandatory EDR. 

A key difference with the case of mandatory EDR is that, since the reduction is voluntary, diesel generation need not be 
considered. In particular, if the reward offered the the LSE for reduction is larger than the cost of diesel, then the operator can 
contribute its whole diesel capacity and, if the reward is smaller than the cost of diesel, no diesel need be used. Compared to 
the mandatory EDR setting, operator need to use more diesel generation when tenants’ bids are high in order to meet the fixed 
reduction target 5\ in the voluntary EDR case, the operator can simply reduce the DR contribution by tenants when their bids are 
high. Thus, the optimization of diesel generation by the operator is separable from the optimization of tenant reduction. 
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This yields a situation where the net profit (from tenant reduction) received by the colo operator is: 

u ■ d — p ■ d (22) 


where p is the unit price the colo operator pays to the tenants to solicit d units of reduction in aggregate, which arises from N 
tenants where tenant i has reduction capacity Di. 

a) An oven’iew o/ColoEDR; It is straightforward to adapt ColoEDR to this setting. We outline its operation in four 
steps below, which parallel the steps in the case of mandatory EDR. 

1) The colo operator receives the voluntary EDR reduction price u and broadcasts the supply function S{bn,p) to tenants according 
to 

Si{bi,p) = Di-^, (23) 

P 


where Di is the capacity of tenant i for reduction determined exogenously. 

2) Participating tenants respond by placing their bids b„ in order to maximize their own payoff; 

3) The colo operator decides the total amount of reduction from tenants d and market clearing price p to maximize its utility. 
Given the bids b = (for,..., 6„), if the operator decides to offer d amount of energy reduction to the utility, then the market 
clearing price p will be 


E” 


" T.UDi-d- 

Hence to maximize the operator’s profit, the operator will chooose d such that 


(24) 


d = argmax (u — p)d = ( w — 


Di 

It follows from the first order optimality of l l25b that 


EEi b. 
EEiA-d 


d. 


d=Y,Di- 


(Er=i 60 (EEiA) 


which gives that the price set by a profit maximizing operator will be 


(25) 


(26) 


p = 


EEiA' 


(27) 


4) Voluntary EDR is exercised. Vn G A/”, tenant n sheds S{bn,p), and receives pS{bn,p) reward. 

b) Discussion: The key difference in the operation of ColoEDR for mandatory EDR and voluntary EDR is in the form 
of the supply function used. In particular, we allow heterogeneity in the supply function for tenants in terms of their capacity 
Dn. Recall, that in the case of mandatory EDR the desired reduction capacity <5 was used. This difference stems from the fact 
that the reduction target is flexible for voluntary demand response and creates significant challenges - both in terms of efficiency, 
since it allows the chance of market power to emerge because of capacity differences, and for analysis, since it adds considerable 
complexity. 


B. Efficiency Analysis of ColoEDR for Voluntary EDR 

Given the adaptation of ColoEDR to the voluntary EDR setting, it is natural to ask how the efficiency of the mechanism 
changes when the operator has flexibility in the amount of response to provide to an EDR signal. Intuitively, the increased 
flexibility leads to the possibility of more inefficiency, but how large is this effect? 
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We again quantify efficiency through a comparison with the (socially) optimal outcome. Assuming that each tenant has a cost 
Ci(-) associated with energy reduction that is convex, increasing, and Ci(x) = OjVa; < 0 (Assumption [T]l. Then the allocation that 
maximizes social utility (the sum of operator’s and tenants’ utility) solves the following problem 

n 

max ud—y^ Ci(si) (28a) 

d.s ' ^ 

i=l 
n 

subject to Si = d (28b) 

i = l 

Q < Si < Di. (28c) 


Finally, note that our analysis makes the following natural assumptions on the unit price u and the marginal cost of each 
tenants. Note that they are analogous to Assumption and Assumption 

Assumption 4. The market clearing price p is lower than the price offered by the utility for any d > 0, i.e., u > . 

Assumption 5. The marginal cost of each tenants satisfies ^ , Vn. 


Before moving to the main results, let us first define some notation. Let 7„ = 


we have = 1- Here 7„ 


S?=i Oi 

behaves like “market share” of tenant n in the voluntary DR market. In the EDR case, 7„ = 1/A for all n. Furthermore, define 
7 = max„ 7„, as the “dominant share” in load reduction among the tenants, and D — max„ 


C. Market Equilibrium Characterization 

As in the case of mandatory EDR, we consider both the cases price-taking and and price-anticipating tenants. 

1) Price-taking Tenants: Given other tenants, each price-taking tenant n optimizes the following cost over bidding value 

bn. 


Pn(^bn,^ — n) — pSn{bn,p'} Cni,Snibn, p')^ — pDn bn Cn{Dn ) 

P 


So, in a price-taking equilibrium (b, d,p), we must have Pn{bn', b_„) > Pn{bn', b_„) hold for each tenant n over all bn > 0. 
Also, the market clearing price must satisfy m and the total reduction must satisfy (HHl. Using techniques similar to the proof 
of Theorem [3 we can completely characterize the the price-taking equilibrium of ColoEDR in voluntary EDR as follows: 
Theorem 14. There exists a unique equilibrium of the game defined by (Pi ,..., Pn) for ColoEDR. For such an equilibrium, 
the vector s* defined by Sn = S{p{h^),bl^) is the unique optimal solution to the following optimization: 


max ud „ ^c„(sn) 

(29a) 

S.t. Sn = d 

n 

(29b) 

d > 0, 0 < Sn < Dn, n = 1,. .. ,N, 

(29c) 


2) Price-anticipating Tenants: Given other tenants, each price-anticipating tenant n optimizes the following cost over 
bidding value b„. 


Qn(,bn, b_yj) 


p(h)Sn(bn,P) - Cn{Sn{bn,P)) 


1 s/^ffnfin 


\ 




bn Cni^Dn 


b. 

^mbm V U 


So, in a price-anticipating equilibrium (b,d,p), we must have Qn(bn; b-n) > Qn(bn; b-n) for all n over all bn- Also, the 
market clearing price must satisfy i24l and the total reduction d must satisfy l l25t . 
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Using techniques similar to the proof of Theorem [T] we can completely characterize the the price-anticipating equilibrium of 
ColoEDR in voluntary EDR as follows. 

Theorem 15. There exists a unique equilibrium of the game defined by (Qi, ■ ■ ■ ,Qn) for ColoEDR. For such an equilibrium, 
the vector s“ defined by sf = S{p{h°'),b'^) is the unique optimal solution to the following optimization: 

U(P 


max ud -—^— -^c„(sn) 

S.t. ^ Sn = d 
n 

d > 0, 0 < Sn < Dn, n ^ I,. .. ,N, 


(30a) 

(30b) 

(30c) 


where, for Sn > 0, 


Cn, 



'YnU 

2 




d+Cniz) \‘^ d+c„{z) zu 

dz ) dz HiDi 


(31) 


and for Sn < 0, Cn(sn) = 0. 

Like in the case of mandatory EDR, the above characterization can be approximated using a modified cost function when 
is small, i.e., when there are a large number of firms and all firms have similar market shares. 

Lemma 16. For 0 < Sn < Dn, the modified cost in d31b can be upper and lower bounded by, 


Cni^Sn) ^ Cn(Sn) ^ Cn(Sn) 3 “ Sn ^ , 


Furthermore, where the left or right derivatives are defined, we have 

d~Cn{Sn) ^ d~CniSn) ^ ^ 8^ CnjSn) ')nU 

dsn ~ dsn ~ dsn ~ ds„ 2 


(32a) 


D. Bounding Efficiency Loss 

We now use the characterization results of Theorem 1 141 and Theorem [15] to analyze the social efficiency of ColoEDR in the 
voluntary EDR setting for both price-taking and price-anticipating tenants. 

Theorem 17. For price taking tenants, the welfare loss of ColoEDR is bounded by udf — ffn Crt(Sn) — 

j«2 

——■ Moreover, the bound is tight. 

Theorem 18. For price anticipating tenants, the welfare loss of Co\oEDR is bounded by ud°‘ — ff^CniSn) > ud*—f2n Cn{Sn)— 
t {^nDn"ln "f ) ■ 

Theorem[T3highlights that the price-taking market equilibrium is efficient when the optimal energy reduction d* is small. This 
is due to the profit maximizing behavior of the operator: when the social optimal d* is large, the operator has greater opportunity 
to raise his profit by lowering the market price. 

Comparing Theorem [TS] with Theorem 1 171 we can see that when tenants are price-anticipating, the additional welfare loss due 
to the price-anticipating behavior of tenants is a function of 7„, the market share of the tenants. It is easy to see the additional 
loss of social utility is minimized when 7„ = 1/N for all n, i.e., when the reduction capacity of each tenant is equal. 

Additionally, we can obtain tight bounds on the market clearing price, energy reduction quantity, and operator’s profit in a 
similar fashion as our analysis done for the mandatory EDR case using Theorem 1 141 and Theorem [T5| The results are summarized 
in Table Inland Table [III] 
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Tenants 

Price Ratio 

Colo Extra Profit 

Welfare Loss 

Price-taking 

E„D„ > 

[0, ud*'^/Er,Du] 

[0, ud*'^/2EnDn] 

Price-anticipating 

[1-^. 1] 

[0, 

[0, m(E„D„7„ -I- 


lABLE 11 


Performance guarantee of CoIoEDR compared to the social optimal allocation. 


Price Markup 

Load Reduction 

Operator’s cost 

[0, u7/2j 

0 ] 

[0, uD\ 


--'lAHLt; 111 

Performance guarantee of CoIoEDR when tenants are price-anticipating compared to them being price-taking. 


E. Market Clearing Price 

Proposition 19. When tenants are price-taking, the operator running ColoEDR uses more on-site generation and pays a lower 
price for power reduction to its tenants than the social optimal. Specifically, d* < d* and (1 — ^ )p* < p* < p*- 

By Lemma [7^ we can characterize the the price markup under the supply function bidding mechanism; 

Theorem 20. Let {p^,d^) be the equilibrium price and total tenant energy reduction when tenants are price-taking, and (p“,d“) 
be those when tenants are price-anticipating, then let 7 = max„ 7„, D — max„ Dn, we have, d* > d“ > d* — Z)/2 and p*' < 
p“ < min(p*,p‘ -I- u'yjW). 

F. Operator’s profit 

Let Uo{p, d) = (u — p)d be the operator’s when the market clearing price is p and the total demand response from tenants 
are d. From the price and vdr-quantity bounds provided in the previous sections, we can give bound on the utility of ColoEDR. 
Theorem 21. Suppose that Assumptions\I\^\^hold. The net utility for the colo operator o/ColoEDR can be characterized by 
0 = Uo{p*,d*) < Uo{p",d°^) < Uoip\d^) < and furthermore, Uo{p\d^) < i7o(p“, d“) -f uL>. 

Table mi shows that as the optimal reduction d* increases, there is more opportunity for the operator to profitably reduce 
market price and increase his own profit. Table m shows further that, when tenants are price-anticipating, they will drive the 
market clearing price up, provide less energy reduction and reduce the operator’s profit. However, all these additional losses can 
be bounded by linear functions of 7, the dominant share of the energy reduction capacity. Hence the loss due to price-anticipating 
behavior of tenants are minimized Di = D 2 = • ■ • = Dn- 

VI. Case Study 

Our goal in this section is to investigate ColoEDR in a realistic scenario. Given the theoretical results in the prior sections, 
we know that ColoEDR is efficient for both the operator and tenants when the number of tenants is large, but that it may use 
excessive on-site generation (in the worst case). Thus, two important issues to address in the case study are: How efficient is the 
pricing mechanism in small markets, i.e., when N is small? What is the impact of the pricing mechanism on on-site generation 
in realistic scenarios? Additionally, the case study allows us to better understand when it is feasible to obtain load shedding from 
tenants, i.e., how flexible must tenants be in order to actively participate in a load shedding program? 

We discuss only on mandatory EDR in this section. The results in the case of voluntary EDR are parallel. 

A. Simulation Settings 

We use trace-based simulations in our case study. Our simulator takes the tenants’ workload trace and a trace of mandatory 
EDR signals from PJM as its inputs. It then executes ColoEDR (by emulating the bidding process and tenants’ energy reduction 
for EDR), and outputs the resulting equilibrium. The settings we use for modeling the colocation data center and the tenant costs 
follow. 
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Fig. 1. (a) Workload traces, (b) Energy reduction for PJM’s EDR on January 7, 2014 El 


Colocation data center setup. We consider a colocation data center located in Ashburn, VA, which is a major data center 
market served by PJM Interconnection 1321 . By default, there are three participating tenants interested in EDR, though we vary 
the number of participating tenants during the experiments. 

Each participating tenant has 2,000 servers, and each server has an idle and peak power of 150W and 250W, respectively. The 
default PUE of the colo is set to 1.5 (typical for colo), and hence, whenever a tenant reduces IkWh energy, the corresponding 
energy reduction at the colo level amounts to 1.5kWh. Thus, the maximum possible power reduction is 2.25MW (i.e., 1.5MW 
IT plus 0.75 non-IT). We assume that the colo operator counts the extra energy reduction at the colo level as part of the tenants’ 
contributions, and rewards the tenants accordingly. 

The colo has an on-site diesel generator, which has cost 0.3$/kWh estimated based on typical fuel efficiency 1441 . 

For setting the energy reduction target received by the colo, we follow the EDR signals issued by PJM Interconnection 
on January 7, 2014, when many states in eastern U.S. experienced an extremely cold weather and faced electricity production 
shortage 1321 . Fig. |l(b)| shows the total energy reduction requirement by PJM, which we further normalize and scale down such 
that maximum energy reduction target for our considered colo is 900kWh. 

Tenant workloads characteristics. We choose three representative types of workloads for participating tenants: tenant 1 is 
running delay-sensitive workloads (e.g., user-facing web service), tenant 2 is running delay-moderate workloads (e.g., enterprise’s 
internal services), and tenant 3 is running delay-tolerant workload (e.g., back-end processing). 

The workload traces for the three participating tenants were collected from logs of MSR 1351 . Wiki 1361 . and a public 
university (anonymous for review), respectively. Fig. 1 1 (a)| illustrates a snapshot of the traces, where the workloads are normalized 
with respect to each tenant’s maximum service capacity. 

The illustrated results us an average utilization for each tenant of 30%, consistent with reported values from real systems (6). 
Our results are not particularly sensitive to this choice. 

There are various power management techniques, e.g., load migration/scheduling, that can be used for reducing tenants’ server 
energy consumption. Here, as a concrete example, we consider that tenants dynamically turn on/off servers according to workloads 
for energy saving subject to SLA |23l. This power-saving technique has been widely studied [Bl, 1231 and also recently applied 
in real systems (e.g., Facebook’s AutoScale ED). 

When tenants save energy for EDR by turning off some unused servers, their application performance might be affected. We 
adopt a simple model based on an M/G/l/Processor-Sharing queueing model, as follows. For a tenant with M servers each with 
a service rate of /r, denote the workload arrival rate by A. When m servers are shut down, we model the total delay cost as 
c(m) = X ■ fj ■ T ■ delay(m) = ^ where u = 7777 denotes the normalized workload arrival (i.e., utilization without 

uM ~ M — m ^ 

turning off servers), T is the duration of an EDR event, and /3 is a cost parameter ($/time unit/job). In our simulations, we set the 
cost parameter for tenant 1, tenant 2 and tenant 3 as 0.1, 0.03, 0.006, respectively, which are already higher than those considered 
in the prior context of turning off servers for energy saving 1231 . Note that we have experimented with a variety of other models 
as well and the results do not qualitatively change. 

We use a standard model for energy usage © and take the energy reduction s as linear in the number of servers shut down. 
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(a) Social cost 


(b) Energy reduction 


(c) Tenants’ net profits 


(d) Operator’s total cost 



Hour Hour Hour Hour 

(e) Market clearing price (f) Tenant I’s utilization (g) Tenant 2’s utilization (h) Tenant 3’s utilization 


Fig. 2. Performance comparison under default settings. Throughout this and later plots, the bars in each cluster are the price-taking, price-anticipating, socially 
optimal, and diesel only (if applicable) outcomes. 


i.e., s = 0-m, where 0 is a constant decided by server’s idle power and T. Then, it yields the following cost function for tenants’s 
energy reduction c(s) = c(|) — c(0), where c( •) is defined in the above paragraph. Note that we have experimented with a 
variety of other forms, and our results are not sensitive to the details of this cost function. 

Finally, note that tenants typically have delay performance requirement which, based on the above queueing model, is translated 
as an utilization upper bound. Such translation is also common in real systems (e.g., default policy for auto-scaling virtual machines 
1261 ). In our simulation, we capture the performance constraint by setting utilization upper bounds for tenant 1, tenant 2, and 
tenant 3 as 0.5, 0.6, and 0.8, respectively. 

Efficiency benchmarks. Throughout our experiments, we consider the price-taking, price-anticipating, and social optimal 
outcomes. Additionally, we consider one other benchmark, diesel only, which is meant to capture common practice today. Under 
diesel only, the full EDR response is provided by the on-site diesel generator. Throughout, our results are presented in grouped 
bar plots with the bars representing (from left to right) the price-taking, price-anticipating, social optimal, and diesel only (if 
applicable) outcomes. 

While other mechanisms (e.g., direct pricing (24), auction 1461 ) have been introduced in recent papers, we do not compare 
ColoEDR with them here because ColoEDR is already typically indistinguishable from the social optimal cost. 


B. Performance Evaluation 

We now discuss our main results, shown in Fig. 

Social cost. We first compare in Fig. |2(a)| the social costs incurred by different algorithms. Note that ColoEDR is close to 
the social cost optimal under both price-taking and price-anticipating cases even though there are only three participating tenants. 
Further, the resulting social costs in both the price-taking and price-anticipating scenarios are significantly lower than that of the 
diesel only outcome. This shows a great potential of tenants’ IT power reduction for EDR, which is consistent with the prior 
literature on owner-operated data center demand response [D, (Ml, dll. 

Energy reduction contributions. Fig. |2(b)| plots EDR energy reduction contributions from tenants and the diesel generator. 
As expected from analytic results, both price-taking and price-anticipating tenants tend to contribute less to EDR (compared 
to the social optimal) because of their self-interested decisions. In other words, given self-interested tenants, the colo operator 
needs more diesel generation than the social optimal. Nonetheless, the difference is fairly small, much smaller than predicted 
by the worst-case analytic results. This highlights that worst-case results were too pessimistic in this case. Of course, one must 
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3. Impact of number of tenants. 


remember that all tenant reduction extracted is in-place of diesel generation, and so serves to make the demand response more 
environmentally friendly. 

Benefits for tenants and colocation operator. We show in Fig. |2(c)| and Fig. |2(d)| that both the tenants and the colo operator 
can benefit from ColoEDR. Specifically, Fig. |2(c)| presents net profit (i.e., payment made by colo operator minus performance 
cost) received by tenants, showing that all participating tenants receive positive net rewards. While price-anticipating tenants can 
receive higher net rewards than when they are price-taking, the extra reward gained is quite small. Similarly, Fig. |2(d)| shows cost 
saving for the colo operator, compared to the “diesel only” case . 

Market clearing price. Fig. |2(e)| shows the market clearing price. Naturally, when using ColoEDR to incentivize tenants for 
EDR while minimizing the total cost, the colo operator will not pay the tenants at price higher than its diesel price (shown via the 
red horizontal line). We also note that the price under the price-anticipating case is higher than that under the price-taking case, 
because the price-anticipating tenants are more strategic. Fiowever, the price difference between price-anticipating and price-taking 
cases is quite small, which again confirms our analytic results. 

Tenant’ server utilization. Tenants’ server utilizations are shown in Figs. |2(f)1|2(g)| and |2(h)| respectively. These illustrate that, 
while tenants reduce energy for EDR, their server utilizations still stay within their respective limits (shown via the red horizontal 
lines), satisfying performance constraints. This is because tenants typically provision their servers based on the maximum possible 
workloads (plus a certain margin), while in practice their workloads are usually quite low, resulting in a “slackness” that allows 
for saving energy while still meeting their performance requirements. 


C. Sensitivity Analysis 

To complete our case study, we investigate the sensitivity of the conclusions discussed above to the settings used. For each 
study, we only show results that are significantly different than those in Fig. 

Impact of the number of tenants. First, we vary the number of participating tenants and show the results in Fig. [3] To make 
results comparable, we fix the EDR energy reduction requirement as well as total number of servers: tenant 1, tenant 2 and tenant 
3 are each equally split into multiple smaller tenants, each having fewer servers. We then aggregate replicas of the same tenant 
together for an easy viewing in the figures, e.g., “tenant 1” in the figures represent the whole group of tenants that are obtained 
by splitting the original tenant 1. One interesting observation is that as more tenants participate in EDR, the market becomes 
more “competitive”. Hence, each individual tenant can only gain less net reward, but both the price and the aggregate net reward 
become higher (see Figs. |3(b)| and |3(c)l l. Motivated by this, one might suggest a possible trick: a tenant may gain more utility by 
splitting its servers and pretending as multiple tenants. In practice, however, each tenant has only one account (for billing, etc.) 
which requires contracts and base fees, and thus pretending as multiple tenants is not possible in a colo. 

Impact of the price of diesel. Fig. |4] illustrates how our result changes as the diesel price varies. Intuitively, as shown in 
Fig. |4(a)[ the social cost (which includes diesel cost as a key component) increases with the diesel price. We see from Figs. |4(b)| 
and |4(c)| that, when diesel price is very low (e.g., O.lS/kWh), the colo operator is willing to use more diesel and offers a lower 
price to tenants. As a result, tenants contribute less to EDR. As the diesel price increases (e.g., from 0.2S/kWh to 0.3$/kWh), 
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(a) Social cost 

Fig. 4. Impact of diesel price. 
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Eig. 5. Impact of EDR energy reduction target. 


the colo operator increases the market price (but still below the diesel price) to encourage tenants to cut more energy for EDR. 
Nonetheless, tenants’ energy reduction contribution cannot increase arbitrarily due to their performance constraints. Specifically, 
after the diesel price exceeds 0.4$/kWh, tenants will not contribute more to EDR (i.e., almost all their IT energy reduction 
capabilities have been exploited), even though the colo operator increases the reward. In this case, tenants simply receive higher 
net rewards without further contributing to EDR, as shown in Fig. |4(d)| 

Impact of EDR requirement. Eig. [5] varies the EDR energy reduction target, with the maximum reduction ranging from 
20% to 120% of the colo’s peak IT power consumption. As the EDR energy reduction target increases, tenants’ energy reduction 
for EDR also increases; after a certain threshold, diesel generation becomes the main approach to EDR, while the increase in 
tenant’s contribution is diminishing (even though the colo operator increases the market price), because of tenants’ performance 
requirements that limit their energy reduction capabilities. 

Impact of tenants’ workloads. In Fig. |6(a)|6(b)[ we vary the tenants’ workload intensity (measured in terms of the average 
server utilization when all servers are active) from 10% to 50%, while still keeping the maximum utilization bounds to 50%, 
60% and 80% as the performance requirements for the three tenants, respectively. While it is straightforward that when tenants 
have more workloads, they tend to contribute less to EDR, because they need to keep more servers active to deliver a good 
performance. Nonetheless, even when their average utilization without turning off servers is as high as 50% (which is quite high 
in real systems, considering that the average utilization is only around 10-30% (61), tenants can still contribute more than 20% 

of EDR energy reduction under ColoEDR, showing again the potential of IT power management for EDR. 

Impact of workload prediction error. In practice, tenants may not perfectly estimate their own workload arrival rates. To 
cope with possible traffic spikes, tenants can either keep more servers active as a backup or deliberately overestimate the workload 
arrival rate by a certain overestimation factor. We choose the later approach in our simulation. Fig. |6(c)|6(d)] shows the result 

under workload prediction errors. We see that both the social cost and market price are fairly robust against tenants’ workload 

over-predictions. For example, the social cost increases by less than 10%, even when tenants overestimate their workloads by 20% 
(which is already sufficiently high in practice, as shown in CU). Other results (e.g., tenants’ net reward, colo operator’s total cost) 
are also only minimally affected, thereby demonstrating the robustness of ColoEDR against tenants’ workload over-predictions. 
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(a) Social cost (b) Energy reduction (c) Social cost (d) Market price 

Fig. 6. Impact of tenants’ workloads and the workload prediction errors. 

VII. Related Work 

Our work contributes both to the growing literature on data center demand response, and to the literature studying supply 
function equilibria. We discuss each in turn below. 

Recently, data center demand response has received a growing amount of attention. A variety of approaches have been 
considered, such as optimizing grid operator’s pricing strategies for data centers (24) and tuning computing (e.g., server control 
and scheduling) and/or non-computing knobs (e.g., cooling system) in data centers for various types of demand response programs 

(D, Q, ED, 1401 . Field tests by LBNL also verify the practical feasibility of data center demand response using a combination 
of existing power management techniques (e.g., load migration) CD. These studies, however, have all focused on large owner- 
operated data centers. 

In contrast, to our best knowledge, colocation demand response has been investigated by only a few previous works. The 
first is 1331 . which proposes a simple mechanism, called iCODE, to incentivize tenants’ load reduction. But, iCODE is purely 
based on “best effort” and does not include any energy reduction target (needed for EDR). More importantly, iCODE is designed 
without considering strategic behavior by tenants, and can be compromised by price-anticipating tenants ED- More relevant to 
the current work is 1461 . which proposes a VCG-type auction mechanism where colocation participation in EDR programs. While 
the mechanism is approximately truthful, it asks participating tenants to reveal their private cost information through complex 
bidding functions. Eurther, the colocation operator may be forced to make arbitrarily high payments to tenants. In contrast, our 
proposed solution provides a simple bidding space, protects tenants’ private valuation, and ensures that the colocation operator 
does not incur a higher cost for EDR than the case tenant contributions. Thus, unlike 1461 . ColoEDR benefits both colocation 
operator and tenants, giving both parties incentives to cooperate for EDR. 

Einally, it is important to note that our approach builds on, and adds to, the supply function mechanism literature. Supply 
function bidding (c.f. the seminal work by 1191 ) is frequently used in electricity markets due to its simple bidding language 
and the avoidance of the unbounded payments typical in VCG-like mechanisms. Supply function bidding mechanisms have been 
extensively studied, e.g., 0, a, cni, ca, im, mi- The literature primarily focuses on existence and computation of supply 
function equilibrium, sometimes additionally proving bounds on efficiency loss. Our work is most related to d, which considers 
an inelastic demand <5 that must be satisfied via extracting load shedding from consumers and proves efficient bounds on supply 
function equilibrium. In contrast, our work assumes that the operator has an outside option (diesel) that can be used to satisfy the 
inelastic demand. This leads to a multistage game between the tenants and the profit-maximizing operator, a dynamic which has 
not been studied previously in the supply function literature. 

VIII. Conclusion 

In this paper, we focused on “greening” colocation demand response by designing a pricing mechanism that can extract load 
reductions from tenants during EDR events. Our mechanism, ColoEDR, can be used in both mandatory and voluntary EDR 
programs and is easy put in place given systems available in colos today. The main technical contribution of the work is the 
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analysis of the ColoEDR mechanism, which is a supply function mechanism for an elastic setting, a setting for which efficiency 
results have not previously been attained in the supply function literature. Our results highlight that ColoEDR provides provably 
near-optimal efficiency guarantees, both when tenants are price-taking and when they are price-anticipating. We also evaluate 
ColoEDR using trace-based simulation studies and validate that ColoEDR is both beneficial to the colo operator (by reducing 
costs), to the environment (by reducing diesel usage), and to the tenants (by providing payments for reductions). 
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Appendix 


A. Proof of Proposition Q] 

When tenants are price takers, they maximize the payout Pn{bn,p) = pSn{bn,p) — c„(sn) over the bid bn- Note that 
bn G [0,p(5] as no tenant will bid beyond pS otherwise the payout Pn < 0. Hence b = (6 i,..., &„) is an equilibrium if and only 
if the following condition is satisfied 


^ < p, 0 < 6„ < pS, (A.33a) 

USn 

> p, 0 < 6„ < p6. (A.33b) 

USn 

At least one feasible solution to exists because it is minimizing a continuous function over a compact set. Furthermore, (|9b) 
- ||93 satisfy standard constraint qualification, hence for the Lagrangian 


L{S, P}=Y^ Cn{Sn) + P{{S 

n n 

there exists optimal primal dual pair (s, p), such that l l9bb and are satisfied, and 

< P, > 0, (A.34a) 

dSn 

> p, > 0. (A.34b) 

USn 

Given the optimal (s, p), let p — p, and bn = p{S — Sn), then d9bb implies p satisfies (O, and l lA.34ab -( IA.34bb implies jA.33ab 
- ( IA.33bb . hence an equilibrium exists. 

Conversely, if (b, p) is an equilibrium and p satisfies the resulting allocation s is optimal to 19}. To see this, if 0 < Sn < 
5 — y for all n, ( IA.33ab -l lA.33bb is equivalent to ( IA.34ab -l lA.34bb if we set p = p, hence (s, p) is primal dual optimal pair for 
If = (5 — y), then Sm = 0,Vm f n. In this case, we set p = mivL{p, d'^Cn{sn)/dSn}, and we can check that (s,p) is 
the primal dual optimal solution for 


B. Proof of Theorem |5] 

By Proposition [T] when tenants are price-taking, for any y, the there is always an equilibrium, and the resulting s is always 
the optimal allocation to provide {S — y) energy reduction. 

Hence we only need to verify that the on-site generation level y is the solution to l ll4ab -( ll4cb . Similar to the proof of Proposition 
[T] by Assumption 12 the first order optimality condition for the y in jl4ab -( ll4cb is -^{y + {N — 1)5) = P- By Proposition [T] 
p satisfies the relation 13, substitute the left-hand-side into 13 and solve for y, we have y = — 1)5. This is 

exactly the on-site generation y that minimizes costo(b, y) given in ( 112b . Hence the datacenter will always pick y that is optimal 
for ( I14ab -l ll4cb . together with Proposition [T] an equilibrium exists, and the resulting allocation (s,p) is optimal for l ll4ab -( ll4cb . 

C. Proof of Proposition 0 

Since y > 0, it suffices to prove that whenever the optimal on-site generation is non-zero, y* > 0, y* > y*. From 13}, the 
Lagrangian of SCM is 

L{s,y,p*,\*) = ^Cn{sn) + ay + p*[[5 -y) - '^Sn) - A*y. 

n n 

By constraint qualification and the KKT conditions, assuming y* > 0, then \ = 0, p* = a, hence the market clearing price in 
the optimal allocation should be p* = a. 
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Next, consider the market price for price taking tenants. From GS), 

t _ _ I (SisA/'fe*)Q 

^ ^ {N-1)S+ y^ ~ y NS 

The second equality yields ~ ^ Substitute this back to l lA.35b . 

t EisArfet {N-l)S + y^ 

^ (Ar-l)5 + y‘ NS “■ 

And note that yt € [0, <5] and p* = a, thus l lA.36b yields ^ P* ^ P*■ 

Finally, from jl4b . the Lagrangian of the price-taking characterization optimization is. 


(A.35) 


(A.36) 


L{s,y,p\\^) =^Cn(Sn) + “ 1)<5)^ +F*((5 - y) - V■ 

n 71 


By examining the KKT condition and using a similar argument to the proof of Proposition [T] we have p* = /r*, also, ^ — 

P* < P* < ■ Thus, Vn, < s^. Since y = S - Sn, y^ > y*. 


D. Proof of Proposition |2] 

From the proof of Proposition [T] we see that when y* > 0, A* = 0, and p* = a. Furthermore, we have Yn 
Sn = S — Flence {NS — ) < S. Conversely, if l llOb holds, then a{N — 1)5 < Yn Proposition [T] and l[2]l, we 

have Yn ^n- ~ {P*{^ ~ + y)- By combining the two equations above: a{N — 1)5 < p*{{N — 1)5 + y*). However, from the 

proof in Proposition [T] we have p* < a, hence we must have y* > 0. 

On the other hand, when the data center operator is profit maximizing, the cost to the operator costo(b, y) — q-Q.^ 

is a convex function in y over the domain p > 0. By first order condition, the cost is minimized when 


/ 

y 


N 5E„fe„ 


{N - 1)5, 


(A.37) 


then y = y' if and only if y' G [0, 5]. However, = Enp(5 — Sn) = p{{N — 1)5 + p) < a{NS), where the last inequality 

is because y < S, and p < a, since operator always has the option to use on-site generation to get unit cost of energy reduction 
at a. Hence we always have y' < 5. So, if p > 0, by l lA.37b . ill lb must hold, conversely, if dl lb holds, then by dA.37b . y' > 0, 
so operator will use y = y'. 


E. Proof of Theorem |5] 

Note that (s*, p*) is a feasible solution to ( [Tit . By Theorem[3 we have X:„c„(s‘„)-f 2 fj(p‘-f(iV-1)5)2 < EnCn(s;)-f 
2 §s(y* + {N — 1)^)^- Rearranging, we have 


J2cn{si) + ay^ - r^c„(s*)-f ap* j < (2^“ (p‘ + P*)) 

- y* - (<5 - y)? + (<5 - y*f\ 

“ IS *\2 ^ “'5 

~2NS^^ ^ ^ - 2N' 


F. Proof of Theorem |6] 

From Proposition [4] we have ^ P^ ^ P* = ct, and 0 < y^ < S, which yields 

cost*(p*,p*) - costo(p*,p‘) =p*(5 - p*) -Pap* - (p*(5- p‘) -Pap*) = (a -p‘)(5 - p*) 
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Substituting the above bounds for p* and p* gives 0 < costo(p*, y*) 


costo(p‘, p*) < 


aS 

N • 


G. Proof of Theorem \7\ 

The proof proceeds in a number of steps. We first show that the payoff function Q„ is a concave and continuous function 
for each firm n. We then establish necessary and sufficient conditions for b to be an equilibrium; these conditions look similar 
to the optimality conditions l lA.33at - jA.33bt in the proof of Proposition [T] but for a “modified” cost function defined according 
to lE}. We then show the correspondence between these conditions and the optimality conditions for the problem l l20at - j20ct . 
This correspondence establishes existence of an equilibrium, and uniqueness of the resulting allocation. 

Step I'. If h is an equilibrium, and Assumption^is satisfied, at least one coordinate ofh is positive. 

By Assumption [21 0 < a < , hence at least one coordinate of b must be positive. 

Step 2: The function (5„(fo„;b_„) is concave and continuous in 6„, for bn > 0. From ( I16t and by plugging p(b) into Sn in 
{D, we have 

/T 1 \ I (f^m^nbm “t“ bn^OiS y / - bn 

Qnibn, b_„) = \ - - - - - -- bn-Cn \ S - , = 

y N V^mytnbm + b, 



When Timyinbm + bn >0, the function bn f \/’P.mytnbm -b bn is a strictly concave function of bn (for bn > 0). Since Cn is 
assumed to be convex and nondecreasing (and hence continuous), it follows that Q„(6„,b_„) is concave and continuous in 
for bn > 0. 

It is easy to show that for Sn to be positive, we need 6„ < bn where | + 4Emy^nbm)^ ■ 

Step 3:/n an equilibrium, 0 < 6„ < bn,'irL. 

Tenant n would never bid more than bn given b_„. If bn > bn, then S'(p(b),&„) =<5 — 

Qn{bn',h-n) becomes negative; on the other hand, Qn{bn',h-n) = 0. 


^/br,+s:„ 


< 0. so the payoff 


We specify the following condition when marginal cost of production is not less than the price: 


W d Cn(sn) ^ ^ 

Vn, --- <p(b), Sn > 0. 

USn 


(A.38) 


This condition is satisfied when tenants are price-taking, in the next step, we show that jA.38t also holds in an equilibrium 
outcome when tenants are price-anticipating. 

Step 4: The vector b is an equilibrium if and only if jA.38b is satisfied, at least one component of b is positive, and for each n, 
bn G [0,6n], and the following conditions hold: 


if 0 < bn <b, 


if D < bn < bn 


1 fd*Cn{Sn) a \ 1 / / d+Cn{Sn) O \ ^ 9+Cn(s„) 2Sna' 

2[—S;:r^2N)^2y[—d^-2N) 

1 fd~Cn{Sn) , a \ 1 fd-CniSn) « , 9“Cn(Sn)2Sna 


(A.39a) 

(A.39b) 


By Step 2, Qn{bn', b_n) is concave and continuous for bn > 0. By Step 3, bn G [0, 6n]. bn must maximize Qn{bn', b_n) over 
0 < 6„ < bn, and satisfy the following first order optimality conditions: 


d^Qnibn, b_n) ^ „ 

dbn 

d Qn(hn;b_n) ^ ^ 
Wn - 


if 0 < bn < bn; 

if 0 < fen < bn; 
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Recalling the expression for p(b) given in l ll3b we have 


if 0 < b„ < bn', 


if 0 < < bn. 


We now note that by l ll3t and (|Tll, we have : ^ and y = (^ ~ 

Substituting these two equations into the above, we have 

la ^ d~Cn{Sn) 1 A 1 aJ-Sn\^„ 

2p(b) N ^ dSn p(b) V 2p(b) N 6 ) - ■ 

la 9+c„(s„) 1 / 1 aJ-s„\^ 

2p(b) N~ ^ dsn p(b) V ” 2p(b) N 5 ) - 

To show l lA.38t holds, we divide into two cases, when W > 2, by rearranging l lA.40at . we have 

d~Cn{sn) 1 ^ 2Ap(b) - g ^ ^ 

dsn p(b) “ 2Ap(b) - a^^^ “ 


1 jaS _ ^ d CnjSn) 1 _ bn 

2^/Tjmbm. V N dSn p(b) 

1 ^ faS _ ^ d^Cn{Sn) 1 

2VSm6^ V N dsn p(b) 


( 1 - 


21] 7 , 


) < 0 , 
) > 0 , 


(A.40a) 

(A.40b) 


This is because by Assumption2Ap(b) — a > 0 when N > 2. Also, we have 2Ap(b) — g" > 2Np{h) — a. Hence 
i [A 3^ holds for N >2. 

When = 1, we can simplify JA.40ab further to 


1 d CnjSn) 1 

2p(b)’^ dsn 2p(b) 


< 0, =>p(b) > i 



d c„(an) \ 
dSn J 


> 


d CnjSn) 
dSn 


The last inequality is because a > ^ otherwise p(b) > a, but profit maximizing operator will not pay for price more 

than a, contradiction. Hence ( IA.38b must hold for all N. After multiplying through dA.40ab - dA.40bb by p(b) and rearranging, 
we have two quadratic inequalities in terms of p(b). Solving the inequalities lead to two sets of conditions of p(b) that satisfy 
the first order optimality conditions, they are: 


if 0 < 6,1 < bn, 

if 0 < 6 „ < bn, 


1 ( d CnjSn) 

2 V dSn 2N J 2 

1 / d+Cn{Sn) , 1 

2 V dSn 2NJ 2 


d-Cn(Sn) a \ d-Cn(Sn) S^a 

dsn ~ 2N J dsn 2NS 

d+Cn{Sn) “ V I A^'^^riiSn) SnOi 

dsn ~ 2 n) ^ dsn 2NS 


< p(b) 
> p(b) 


(A.41a) 

(A.41b) 


However, only the conditions with plus sign satisfies dA.38b . the conditions with minus sign violates dA.38b because since 


VSn > 0, 


Kb) < ^ < 


9^Cn(0) 

dSn 


< 


d CnjSn) 
dSn 


Hence we discard the conditions with minus sign and note that dA.41bb -l |A.41ab corresponds to dA.39ab - dA.39bb . 

Conversely, suppose that b has at least one strictly positive component, that 0 < bn < bn, and that b satisfies dA.38b and 
dA.39ab -( lA.39bb . Then we may simply reverse the argument: by Step 2, Qn{bn', b_„) is concave and continuous in bn > 0, and 
in this case the conditions dA.39ab -( lA.39bb imply that bn maximizes Q„( 67 i;b_„) over 0 < bn < bn- Since we have already 
shown that choosing bn > bn is never optimal for firm n, we conclude that b is an equilibrium, and it is easy to check that in 
this case condition dA.38b is satisfied. 

Step 5: If Assumption^holds, then the function Cn(s„) defined in ED is continuous, and strictly convex and strictly increasing 
over Sn > 0 , with c(sn) = 0 for Sn < 0 . 

Cn(sn) is continuous on > 0 by continuity of Cn and on s„ < 0 by definition. We only need to show that £,,(0) = 0, this is 
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because when Sn = 0, Cn(s„) — 0, Sn-^ =0, and integrating from 0 to Sn is 0. Hence Cn{sn) = 0 for < 0. 
For Sn > 0, we simply compute the directional derivatives of Cn' 


d'^CnjSn) 

dSn 

d~Cn{Sn) 

dSn 


1 / a d^Cn(Sn)\ . 1 

2\2N'^ dSn 


+ ■ 


OL (Sn ) \ C-ni^SrC} SnO^ 


2N 


dSn 


+ 2 - 


dSn 


NS ’ 


1 / d Cn{Sn) \ 1 

2\2N'^ dsn ) 2 


_a _ 9+Cn(s„) \ d+Cn{Sn) SnO- 

2N dSn / dSn NS' 


Since Cn is strictly increasing and convex, for 0 < s„ < we will have 


d'^c(Sn) ^ d c(Sn) ^ d~''c(Sn) 
dSn dSn ~ dSn 


This guarantees that Cn is strictly increasing and strictly convex over s„ > 0. 

Step 6 : There exists a unique vector s > 0, j/ > 0 and at least one scalar p > 0 such that: 


1 

2 

1 

2 


d^CnjSn) 1 

dsn 2N 2 


cl Cn(Sn} ^ I ^ 

^ '^InJ ~^2 


d+Cn(Sn) _ d+Cn(Sn) 2Sn 


dSn 


2N J 


dSn 


NS 


d+CniSn) a \ d+CniSn) 2s„Q 

W J NS' 


^{y+{N-l)S)=p-, 


^Sn = (S-y). 


> p, if Sn > 0 ; 

(A.42a) 

< p, if Sn > 0; 

(A.42b) 


(A.42c) 


(A.42d) 


n 


The vector s and y is then the unique optimal solution to l l20aF(l20ct . 

By Step 5, since Cn is continuous and strictly over the convex, compact feasible region for each n, we know that j20aFJ20ct 
have a unique optimal solution s,y. As in the proof of Proposition [T] form the Lagrangian 


y,p)^Yl +{N- l)Sf + p{{S - y) - ^ Sn). 

n n 

By assumption [2 y > 0, and by the fact that Cn(sn) = 0 for Sn < 0, Sn > 0. there exists a Lagrange multiplier p such 
that {s,y,p) satisfy the stationarity conditions which corresponds to JA.42ab -( lA.42ct when we expand the definition of Cn(sn), 
together with the constraint l lA.42db . The fact that p > 0 follows by l lA.42cb as p > 0. 

Step 1' If s > 0,y > 0 and p > 0 satisfy l lA.42ab -l lA.42db . then the triple (b, p, y) defined by bn = {S — Sn)p is an equilibrium 
as defined in (HI} and GIJ. 

First observe that with this definition, together with l lA.42db and the fact that Sn > 0, we have bn > 0 for all n. Furthermore, we 
can show bn < bn, since Sn > 0, bn < pS, but by l lA.42cb -( IA.42db . we have 


n 

Substitute the definition Sn = S — ^ into l lA.43b . we have 


(A.43) 


Q Yjnbn 

'ns p 


^ p = 


^nbnCX 

NS ■ 


(A.44) 


Substituting l lA.44b into &„ < p5, we have bn < y ^ Solving this inequality we have bn < bn- 

Finally, at least one component of b is strictly positive, since otherwise we have Sni = Sn 2 = S for some nl 7 ^ n2, in which 

case > 5, which contradicts dA.42db . (or Sn = S, y = 0, contradicting our assumption that y > 0.) 

By Step 4, to check that b is an equilibrium, we must only check the stationarity conditions ( IA.39ab -l lA.39bb . We simply note 
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that under the identification bn = p{S — Sn), using dA.44b and ( IA.42cb . we have 


y = 


T,„b„NS 

- {N-l)6-, p = 


{N-l)5 + y 


= p(b). 


Substitute p(b) into ( IA.42ab will correspond to ( IA.39ab . and dA.42bb implies dA.39bb and dA.38b because ^ 

Thus (b, p, y) is an equilibrium. 

Step 8: If (h,p{b),y) is an equilibrium, then there exists a scalar p > 0 such that the vector b defined by Sn = S(p(h), b„) 
satisfies dA.42ab - dA.42db . 

We simply reverse the argument of Step 7. Since b is an equilibrium bids, by dl8b and Sn = S(p(b), b„), we have Sn = {S—y), 
i.e., dA.42db is satisfied. By Step 4, b satisfies dA.39ab - jA.39bb . Since t/ > 0 by Assumption 0 < Sn < 5 for all n, let 


P = 


max 



/ d CnjSn) 

V dSn 




Cn(,Sn'} 

dSn 


a d+Cn{Sn) 2Sna'[ 

2N’ ^ dSn N5 J' 


In this case p > 0 and 0 < bn < bn for all n, so dA.39bb implies dA.42bb by definition of p, and dA.42ab holds by dA.39ab and 
the fact that d~Cn{sn) < d'^Cn{sn) (by convexity). 

Step 9: There exists an equilibrium b, and for any equilibrium that price is greater than marginal cost, the vector s defined by 
Sn = S{p{h),bn) is the unique optimal solution of dA.42ab - dA.42db . 

The conclusion is now straightforward. Existence follows from Steps 6 and 7. Uniqueness of the resulting production vector s, 
and the fact that s is an optimal solution to (I20a-(l20cb. follows by Steps 6 and 8. 


H. Proof of Lemma 

We exploit the structure of the modified cost Cn to prove the result. Note that, for all n, Sn > 0, if we define Gn{sn) = 



First inequality is because 2 > 0, last equality is because by convexity and Assumption]^ we have ^ ^ — fk- 

Hence we have c„(s„) = i (cn(s„) + + \Gn{sn) > Cn(s„). 

On the other hand, notice that Sn < 5, we have: 


Gn(Sn} ^ 


r/ 

r/ 


/d+Cn(z) a I d+Cn(z) 2Sa 

V HV J 




^ d+Cn(z) a ^ 


2N J 


dz = Cn(Sn) + 


Hence we have Cn(sn) = | (cn(sn) + Sn-^) + ^Gn(sn) < Cn(sn) + Sn-^- The bounds for the left and right derivatives can 
be obtained from taking the left (or right) derivatives at the bounds of Gn{sn)- 


I. Proof of Theorem [9] 

Firstly we will prove one side of the inequality p* < p°‘,y^ fz y°‘■ Recall that by the examinging the Lagrangians of the 
optimizations in Proposition|4]in and Theorem[7] we have p‘ > d Cn{Sn)/dSn,P^ < d* Cn{sh)/dSn,P°‘ > d CniSn)/dSn, p°' < 
c)''"Cn(s5^)/c)Sn, at the domain where the left or right derivative is defined, and p‘ = -^{y*+ {N— l)S),p°' = + 1)^)- 

If y* > p“, then p* > p“. Also, because the total energy reduction 5 is constant, we have Sn < 



























































30 


Hence there exist > 0 such that s“ > for some r £ {1,. .., A^}. Therefore, by strict convexity of Cn (Assumption [T}: 


d+Crisj) ^ d Crjs’j.) 
dSr dSr 


However, by Lemma [ 8 ] we have ^ > a_c^X£ri, Hence, we have 


d Cr(Sr) ^ d Crjs^) 
dSr ~ dSr 


(A.45) 


(A.46) 


Combining ( IA.45b and dA.46b . we have < p“, contradiction. Hence we have y* < S/“, and < p“. 

Next we show the other side of the inequality p“ < p* + 2 /“ < p* + |, by the previous part, we have 

Let n = argmax^(s^ — s‘^), clearly > s^, otherwise Sn < contradiction. 

If si = s^, then Vm, slr^ = s^, and p‘ = p“, then p* = p“. 

If Sn > Sn, then by strict convexity of Cn (assumption [Til, and the fact that > 0 , > 0 , we have 


a+Cn(Sn) ^ d Cnjsj) ^ a 

Sn Sn 

Also, by Lemma m we have this gives us 

a ^ d^Cnjs^) ^ l9+C„(s°) _C^ 

^ “ dSn ~ dSn 2N' 


(A.47) 


(A.48) 


Combining dA.SSb and dA.59b . we have p“ < P^ + ^ ■ Hence we have 


2N ■ 

+ (N - m < ^(p‘ + (iV - 1)5) + 


J. Proof of Theorem 1731 

Given any e > 0, let e' = ^e. Consider the following set of cost function: 


ci(si) = < 


2 JV'®!’ 

“(f - IIt)si + Ci> 

‘lotSl + C 2 5 


if Si < e'\ 
e' < Si < S — e'; 
Si > 5 — e' 


where Ci, C 2 are constants that make ci continuous then ci is piece-wise linear and convex. Also, Vm f 1, Cm(sm) = 2aSm- 
It is easy to see that s* = 5 — e' and y* = e' is the optimal allocation. 

Let sT = p“ = S — e', and Vm f l,sf = 0, we claim that (s“, p“) is the unique optimal solution to d20ab - d20cb . To see 
this, let p = a(l — e/{NS)), then. 


^(p“ + (iV-l)5) = p; ^4 = 5-p“; 


9 ci(s?) ^ ^ a+ci(sf) a+c^(o) ^ ^ ^ 1 

—^-< p; —^-> p; —^-> p, Vm 7 ^ 1 . 

OSl OSl OSm 

where the second inequality is because if we let Hn be the term under square root for ^ cn(sn) ^ 


Hr^ = 


fd+Cn{sn) , a as. 


V as„ ^2N iV 5 ^ 

9+Cn(s„) , a a s„ 


oP- (5 + s„)(5 - s„), 




52 


9s„ 


, an \ 




), and C 2 = — “ 3e') 


(A.49a) 

(A.49b) 
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Note that ^ + w) 1^"- Hence we have ^ ^ = P- These conditions correspond 

to ( IA.42at -l lA.42dt . so we conclude that (s®, y°‘) is the unique optimal solution to ( I20at -( l20cb . Hence y°' — y* = S — 2e' = 5 — e. 


K. Proof of Theorem \11\ 

As {s*,y*) is a feasible solution to I 20 I 1 , by Theorem [T] we have 


E ^ E ^"(4) + ^iy* + iN- l)Sf. (A.50) 


Rearranging, we have J2n Cn(s^) + at/“ - c„(s*) + ay*) < § - y*){l - . By Corollary [TO] and the fact 

that y* < S,y°' < S, both terms in the brackets are positive, hence right-hand-side expression is maximized when y* —>■ 0^ and 
j/“ = 5, hence 



(A.51) 


However, by Lemma[8] we have c„(s*) < Cn(Sn) + fwi'En «") < En Cn(Sn) + and c^isf) > 
Substituting the above relations into | |A.5H and rearranging, we have the desired result. 


(^n) ■ 


L. Proof of Theorem 1721 

First, we compare the cost by operator between the price-taking and price anticipating cases, by definition GD and rearranging, 
we have costo(p“, y“) - costo(p*, y*) = (p“ - p*) (5 - y*-) + [a - p“) (i/“ - y*-). By the fact that p“ = -f (iV - 1)5) 

(shown in Theorem H and the fact that 0 < j/“ < 5, we have 

a <P°' <ot- (A.52) 

By the upper bound of p“ in ( IA.52b and the upper bounds of p‘, y* in Theorem we have 

costo(p“, t/“) — costo(p*, y*) > 0. (A.53) 


Similarly, using the lower bound of p“ in JA.52t and the upper bounds of p“,y“ in Theorem [9l we have 


costo(p“,y“) - costo(p*,y*) < 


f—)• 

\2NJ 


(5) -f Q 


N 


aS 

7 ^' 


Second, we compare the cost by the operator to the social optimal. Since the energy reduction goal 5 is the same, by Proposition 
|4]and Corollary 1 101 we have p* < p* and p“ < p*. Hence we have costo(p*, y*) < costo(p“, y“) < costo(p*, y*). Furthermore, 


costo(p*,y*) - costo(p*,y*) = aS - {p\S - y*) -f ay^) 

={a - p‘)(5 -y^) = a (5 - y‘) < E. (A.54) 

Lastly by jA.53b and ( IA.54b . we have cost(p*, y*) — cost(p“, y“) < cost(p*, y*) — cost(p*, y‘) < 


M. Proof Sketch of Theorem 1741 

Theo proof is similar to that of Theorem which uses Proposition (T] note that in the VDR case, we can change N5 in the 
proof of Theorem [3 to T^nDn, and interpret the variable y as E„77„ — d, a as u and 7 „ as 1/N in the proof of Theorem [3 
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N. Proof Sketch of Theorem 1751 

Theo proof is similar to that of Theorem [T] note that in the VDR case, we can change N5 in the proof of Theorem [3 to 
T^nDn, and interpret the variable y as T,nDn — d, a as u and 7 „ as 1/A^ in the proof of Theorem^ 


O. Proof of Lemma 1761 

For the bound on the magnitude of the modified cost, we exploit the structure of the modified cost Cn to prove the result. 
Note that, for all n, Sn > 0, if we define G„(sn) = \j ~ , then 

^ ^ ^ / f d+c„{z) TnwVj _ / \ 

G„(s„)>y^ y —J dZ-Cn{Sr.) s„ —. 

First inequality is because z >0, last equality is because by convexity and Assumption we have ^ ^ 

HcnCC W6 ll3.V6 Cn(Sn) — "2 (•^7t.(S7t,) ~h ^ Cn(Sn). 

On the other hand, notice that Sn < Dn, we have: 


Gni^Sn') ^ 


r/ 


/ d+Cr{Sn) 

V dSn 


Ulr, 

2 


+ 2 ^ ^nUdz = Cn{Sn) + 

OSxi Zily 


Hence we have Cn(sn) = | (c„(sn) + + \Gn{sn) < c„(s„) + s„^^. The bounds for the left and right derivatives can 

be obtained from taking the left (or right) derivatives at the bounds of Gn(sn)- 


P. Proof of Theorem 1771 

We can combine ( 126b with ( 127b to eliminate the term to get a relation between market price and the vdr-quantity 

decided by the profit maximizing operator: 

n 

(A.55) 

2^i=l 

By the characterization theorem, we have ud* — 2 ^ d - '^n ‘^n(Sn) < ud^ — 2 ^ d -Rearranging, we 

have 


ud* 


^ Cn(s*) <ud^ c„(si) + 


< ud* — ^ Cn(si) + 

n 


u{d*^ -d*^) 

2 En Dn 


where the last inequality is due to the fact that d* > 0. 


Q. Proof of Theorem [TS] 

By Theorem[T5] we have ud“ — Cn{Sn) > ud‘^ — Cn(Sn) Using Lemma [7^ and rearranging, we have 


tid“ - y^ Cn(Sn) 

n 

>ud* - '^Cn(Sn) - 


l{d*^ — 'fnU 


2Eti Dn 


-E' 


^ f *\ '^'Y^nDn „ 7nM 

>ud -^Cn{Sn) -^- 2^^^ — 

n n 

=ud* - ^c„(4) - ^ ^77n(l + 7n)- 
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where the first inequality is because Cn{Sn) < Cn{Sn), and Cn(s^) < Cn(Sn) + and the second inequality is becuase 

Sn < D„. 


R. Proof of Proposition 1791 

The Lagrangian of the welfare maximization problem l l28t is 

n n n n 

L{s,d-, p, A, A) = ud — ^ Ci(si) + Si — d) + ^ A.si + ^ A;(A — Si). 

i=l i=l i=l 1=1 

By constraint qualification, the optimal primal dual solutions (s, y, p) satisfies the KKT conditions 


P* = u, 


d~Cn{Sn) 

dSn 

d^CnjSn) 

dSn 


< P*, if 0 < Sn < Dn 
> P*, if 0 <Sn<Dn. 


Hence the market clearing price in the optimal allocation should be p* = u. Now consider the market clearing price for price 
taking tenants, from l lA.55t . we know that = u — <u = p*. Similarly, by Theorem [14] and looking at the Lagrangian 

of we have ^ ^ 0 < hence for all n, such that > 0 and s* < Dn, we have 

d-Cr,{si) , t , * , 9+Cn(Sn) 

- 5 - <P <P < - 5 -, 

USn USn 


hence sh < for all such n, on the other hand, if = 0 or = Dn, we also have < Sn, hence d* = f2n Sn = d*. 

Finally, by the fact that d* < d* and l lA.SSb . we have 


p = u — 


ud^ 




> U — 


ud* 


X^n 


= 1 - 


X^n 


S. Proof of Theorem 1201 

Firstly we will prove one side of the inequality p^ <p°‘,d^ > d“. We can prove this by contradiction. Suppose d* < d“, then 
by (|A35), P* yp"^. Also, J2n 

Hence there exist s“ > 0 such that s“ > s* for some r G N}. Therefore, by the stationarity of the Lagrangian of 

l l29b and strict convexity of Cn (Assumption [T|l: 


t ^ d+Crjsj) d Crjs^) 

~ dSr dSr 

However, by the stationarity of the Lagrangian of m and Lemma m we have 


dSr 


dSr 


(A.56) 


(A.57) 


Combining ( IA.45b and JA.46b , we have p* < p“, contradiction. Hence we have y* < i/“, and p* < p“. 

Next we show the other side of the inequality p“ < p^ + d“ < d* — ■£, by the previous part, we have X]„ ^n < En ^n- 
Let n = argmax^(s^ — sif), clearly Sn > otherwise X]„ < En contradiction. 

If Sn = Sn, then Vm, sX = Sm> and By dA.55b . p* = p“. 

If Sn > Sn, then by stationary condition of the Lagrangian of ( 129b and strict convexity of c„ (assumption Q}, and the fact 
that Sn > 0, > 0, we have 

d'^'CniSn) d~Cn(si) t 
dSn 


S: 


(A.58) 
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Also, by Lemma 17^ and stationary condition of Lagrangian of < [3Qt . we have definition of 

a ^ d+Cr,{s^) ^ d+Cr,{s^) 7 ^ 

^ “ dSn ~ dSn 2 

Combining ( IA.58b and JA.59b , we have p“ < < p* _(_ 2^. Substitute the above relation into ( IA.55b . we have 


Md“ ud* wy 

D 
2 ’ 


J2ri 


la ^ 7t ^ 

d > d - 


the last inequality is because _D = max„ D„ = ^™)7- 


T Proof of Theorem 1271 

Firstly, by theorem 1^ d° < d^, and p“ > p*, hence Uo{p°',d°) < Uo{p*,d*). Furthermore, 

[/o(p*, d*) - [/„(p“, d“) = (u - P*)d* - (u - p“)d“ 

=(u-p*)(d‘-d“) + d“(p“-p*). 

By theoreml^ we have d* < d“ + D/2, p“ < p* + M 7 / 2 , and by the fact that d“ < D„, we have 

Do(p*,d*) - D„(p“,d“) < u. I + (y]D„)^ = uD. 


(A.59) 


(A.60) 


(A.61) 












